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Abstract — This  paper  proposes  an  approach  to  the  fusion  of 
multi-modal  sensor  data  for  the  purpose  of  personnel  intrusion 
detection.  The  focus  is  on  using  low  cost  non-imaging  sensors 
for  applications  such  as  border  crossings  where  issues  of  rapid 
deployment  and  power  consumption  are  prevalent.  The  main 
challenge  of  fusing  data  from  such  sensors  lies  in  the  wide 
variation  of  granularity  of  classification  that  they  may  provide. 
While  some  sensors  may  provide  detailed  characteristics  of  the 
motion  in  a  scene  and  therefore  a  very  fine  classification, 
others  may  only  provide  simple  alerts  and  little  detail.  In  order 
to  fuse  data  from  a  wide  range  of  sensors  that  are  often 
designed  for  disparate  applications,  an  approach  based  on  the 
Dempster-Shafer  theory  of  evidence  is  used.  The  implicit 
handling  of  uncertainty  and  ambiguous  propositions  leads  to  a 
convenient  hierarchical  approach  that  can  represent  data  from 
numerous  sensor  modalities. 
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I.  Introduction 

The  Dempster-Shafer  (D-S)  mass  function  is  used  in 
effect  as  a  common  representation  of  the  heterogeneous 
sensor  data.  In  order  to  cast  each  data  source  in  this  form, 
first  the  raw  data  is  reduced  to  points  in  a  multi-dimensional 
feature  space  specific  to  each  sensor.  From  there,  an 
approach  is  outlined  that  uses  a  distance  metric  in  the 
feature  space  to  assign  mass  to  each  state  in  the  class 
hierarchy.  This  hierarchy  begins  with  the  full  frame  of 
discernment  which  represents  complete  uncertainty.  From 
there  it  proceeds  as  an  n-array  tree  broken  down  in  to  further 
subclasses  until  the  finest  granularity  of  classification  for  the 
specific  sensor  is  reached.  For  an  input  point  to  be  classified 
mass  is  assigned  iteratively  down  the  tree.  In  doing  so,  two 
key  steps  are  taken.  First,  the  uncertainty  is  estimated  as  a 
function  of  the  ratio  of  the  distance  between  the  two  closest 
child  nodes.  If  the  input  point  is  deemed  equidistant  from 
the  child  nodes,  there  is  a  great  deal  of  uncertainty  and  the 
mass  function  should  reflect  that.  On  the  other  hand, 
significant  disparity  indicates  a  much  greater  likelihood  of 
one  subclass.  This  distinction  leads  to  the  second  step, 
where  any  mass  not  assigned  to  uncertainty  is  split  between 
the  child  nodes  as  a  function  of  the  ratio  of  their  distances. 
The  final  result  is  a  representation  of  the  likelihood  of  each 
singleton  class,  as  well  as  all  unions  of  these  classes 


representing  uncertain  states.  These  D-S  mass  functions  can 
now  be  fused  using  Dempster’s  rule  of  combination,  and 
classification  rules  can  be  derived  to  provide  a  more  robust 
singular  solution. 

The  preceding  approach  is  derived  with  simulated  data, 
and  subsequently  demonstrated  on  two  sensor  modalities:  an 
ultrasonic  micro-Doppler  sensor  and  a  PIR  profiling  sensor. 
The  ultrasonic  sensor  is  able  to  extract  human  motion  by 
identifying  the  periodicity  of  a  human  walker’s  gait  in  the 
sensor  field  of  view.  The  sensor  can  distinguish  between  a 
human,  an  unknown  object  in  the  scene,  and  background 
ambience.  On  the  other  hand  the  profiling  sensor  is  capable 
of  distinguishing  a  horse  from  a  human.  The  sensor  forms  a 
2-D  image  of  height  versus  time,  and  from  this  the 
orientation  and  eccentricity  of  the  object  are  estimated  and 
matched  to  known  distributions  of  human  and  horse 
profiles.  These  two  sensors  illustrate  the  approach  on 
differing  hierarchies  of  class  representations,  and  an 
example  is  given  to  show  the  fusion  of  the  two  data  types. 
The  paper  concludes  with  a  discussion  of  the  results  and  in 
particular  future  directions  of  the  work  and  how  enhanced 
data  sets  could  aid  the  evaluation  of  the  approach. 

II.  Fusion  Background 

The  method  outlined  herein  is  developed  based  on  the 
Dempster-Shafer  theory  of  evidence.  The  implicit  handling 
of  uncertainty  and  ambiguous  classes  in  this  approach  are 
particularly  useful  in  applications  of  multi-modal  sensor 
fusion.  This  approach  allows  combination  of  sensor  outputs 
that  effectively  classify  different  sets  of  objects  with  varying 
levels  of  granularity. 

Much  like  in  a  discrete  Bayesian  approach,  Dempster- 
Shafer  implementation  begins  by  defining  the  frame  of 
discernment  ;  the  set  that  contains  all  possible  outcomes 
coq.  A  mass  function  assigns  belief  in  each  of  these  outcomes, 
but  unlike  a  Bayesian  probability  mass  function,  mass  can 
also  be  assigned  to  unions  of  outcomes  representing 
uncertainty  between  them.  In  this  context,  the  outcomes  are 
specific  actors  or  actions  detectable  in  a  scene  such  as  a 
vehicle  moving  or  a  person  walking,  and  any  assignment  to  a 
union  of  outcomes  indicates  uncertainty  in  performing  a  finer 
classification. 


2209 


Form  Approved 
OMB  No.  0704-0188 


Report  Documentation  Page 


Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number 


1.  REPORT  DATE 

JUL  2012 

2.  REPORT  TYPE 

3.  DATES  COVERED 

00-00-2012  to  00-00-2012 

4.  TITLE  AND  SUBTITLE 

Dempster-Shafer  Fusion  for  Personnel  Detection:  Application  of 
Dempster-Shafer  Theory  with  Ultrasonic  micro-Doppler  and  PIR  Sensors 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

US  Army  RDECOM-ARDEC, Acoustics  &  Networked  Sensors 

Division, Picatinny,NJ, 07806 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS (ES) 

10.  SPONSOR/MONITOR’S  ACRONYM(S) 

11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 


12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

Presented  at  the  15th  International  Conference  on  Information  Fusion  held  in  Sinapore  on  9-12  July  2012. 
Sponsored  in  part  by  Office  of  Naval  Research  and  Office  of  Naval  Research  Global. 

14.  ABSTRACT 

This  paper  proposes  an  approach  to  the  fusion  of  multi-modal  sensor  data  for  the  purpose  of  personnel 
intrusion  detection.  The  focus  is  on  using  low  cost  non-imaging  sensors  for  applications  such  as  border 
crossings  where  issues  of  rapid  deployment  and  power  consumption  are  prevalent.  The  main  challenge  of 
fusing  data  from  such  sensors  lies  in  the  wide  variation  of  granularity  of  classification  that  they  may 
provide.  While  some  sensors  may  provide  detailed  characteristics  of  the  motion  in  a  scene  and  therefore  a 
very  fine  classification  others  may  only  provide  simple  alerts  and  little  detail.  In  order  to  fuse  data  from  a 
wide  range  of  sensors  that  are  often  designed  for  disparate  applications,  an  approach  based  on  the 
Dempster-Shafer  theory  of  evidence  is  used.  The  implicit  handling  of  uncertainty  and  ambiguous 
propositions  leads  to  a  convenient  hierarchical  approach  that  can  represent  data  from  numerous  sensor 
modalities. 


15.  SUBJECT  TERMS 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

18.  NUMBER 
OF  PAGES 

19a.  NAME  OF 
RESPONSIBLE  PERSON 

a  REPORT 

unclassified 

b  ABSTRACT 

unclassified 

c  THIS  PAGE 

unclassified 

Same  as 
Report  (SAR) 

6 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Two  quantities  that  are  useful  in  generating  classification 
rules  based  on  D-S  mass  functions  are  belief  nd  plausibility. 
Belief  is  computed  as  the  sum  of  all  outcomes  that  directly 
support  a  given  outcome,  and  can  be  view  d  as  an  upper 
bound  on  the  likelihood  of  said  outcome.  Plausibility  on  the 
other  hand  is  computed  as  the  sum  of  all  outcomes  that  do 
not  explicitly  contradict  a  given  outcome.  This  senes  as  a 
lower  bound  on  the  outcome  likelihood. 


Bel{A)=^m{B)  (1) 

BqA 

Pis  (A)  —  X"'(5)  (2) 

AnB*0 


In  this  implementation,  it  is  assumed  that  each  sensor 
produces  a  mass  function  in  the  presence  of  SDine  input.  The 
mass  functions  from  individual  sensors  can  be  combined  by 
Dempster's  rule  of  combination,  given  hi  (3  >.  By  summing 
the  mass  over  intersections  between  the  two  sensors,  mass 
assigned  to  more  general  outcomes  is  being  incorporated  to 
support  those  that  are  more  specific. 


111(A)  = 


2  mi  (b)>»2  (c) 

BnC=A _ 

1-  £m,(B)m2(C) 

BnC*0 


(3) 


III.  MASS  FUNCTION  ASSIGNMENT 

The  approach  for  automated  generation  of  mass  functions 
from  sensor  feature  data  is  illustrated  by  way  of  an  example 
using  simulated  data.  Figure  1  illustrates  t  e  hierarchy  of 
classes  in  the  simulated  data  set.  This  hierar  hy  is  designed 
to  simulate  a  sensor  that  discerns  two  levels  of  classification. 
For  example,  classes  A  and  D  may  repres  art  human  and 
vehicle  respectively.  Classes  B  and  C  in  turn  vould  represent 
specific  vehicle  types. 


Figure  1 .  Hierarchy  of  clas  »es  in  simulated  data 


To  begin  assigning  mass  to  all  states  in  the  hierarchy, 
consider  that  all  mass  must  sum  to  1 .  Therefore,  at  the  root 
node  □.  mass  totaling  1  must  b?  split  between  the  left  and 
right  sub-trees,  with  any  amoun  “left  behind"  representing 
our  uncertainty  between  the  two.  Clearly  the  relative 
likelihoods  of  classes  in  each  su  >-tree  should  drive  the  split, 
but  tliis  fails  to  account  for  an  uncertainty.  To  overcome 
this,  the  assignment  to  uncertainty  will  be  considered  first  as 
the  ratio  of  the  minimum  to  maximum  likelihoods  of  child 
nodes  as  stated  in  equation  (4).  1 1  tliis  formulation,  when  the 
children  are  equally  likely,  the  majority  of  mass  will  be 
assigned  to  total  uncertainty.  Conversely,  when  one  is  far 
more  likely  than  the  other,  there  is  little  uncertainty.  A  scale 
factor  is  included  to  allow  some  nass  to  be  distributed  down 
the  tree  even  in  the  case  of  equally  likely  sub-trees.  The 
remaining  mass  is  split  between  the  child  nodes  as  in 
equation  (5),  where  the  ratio  of  listance  to  the  current  child 
to  the  sum  of  all  child  distances  scales  the  assignment. 


m(0)  =  a 


min(Z(x)) 

max(Z(x)) 


(4) 


?w(<y,)  =  (l -//;(<?)) 


Zfoft.g,2) 


(5) 


Figure  2  shows  the  generated  simulated  dita.  The  data  is 
normally  distributed  hi  a  two  dimensional  feature  space  with 
varied  means  and  unit  variance.  Consider  these  points  as 
training  samples  used  to  build  a  model  from  which  mass 
functions  can  be  derived.  Note  that  no  sampl  s  are  explicitly 
labeled  as  class  D.  All  points  belonging  to  su  )-classes  B  and 
C  will  be  used  to  define  the  prior  statistics  of  class  D. 

In  order  to  proceed,  a  suitable  distance  netric  must  be 
defined  to  determine  the  distance  from  an  hip  it  pohit  to  each 
class.  For  tins  initial  implementation,  the  Gaussian  log 
likelihood  L(x\f.iuG?)  will  be  used  to  genera  e  the  vector  d 
containing  class  distances.  Any  alternate  metric  can  be 
chosen  to  best  suit  real  world  data  sets. 


Tins  process  can  nowr  be  repeated  iteratively  down  the 
class  hierarchy,  with  some  mas>  less  than  1  remaining  hi 
each  node  to  be  split  amongst  the  child  nodes.  Figure  3 
presents  this  approach  in  algorit  imic  form.  The  final  output 
is  a  mass  function  that  sums  to  1  and  assigns  mass  based  on 
the  likelihood  hi  and  uncertainty  unongst  each  outcome. 


Figure  2.  Simulated  data 
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Algorithm  Iterative  Mass  Computation 

Input: 

-  d  :  vector  contains  distance  from  input  to  e  ich  class 
-Tii  sub  tree  tree  rooted  at  node  i,  initially  T 

-  rmass:  mass  at  root  node,  initially  1 

compute_ds_mass(d,T,r_mass) 

if  (!  children) 
mass(i)  =  rmass 
else 

mass(i)  =  r_mass*exp(-a*max(d)/min(d)) 
for  j  =  l:length(children) 

mass®  =  (l-mass(i))*d(j)/sum(d) 
compute_ds_mass(d,Tj,mass(j)) 
end  for 
end  if 

Output: 

-  mass:  vector  contains  mass  assigned  to  all  lodes 


Figure  3.  Algorithm  for  computing  mass  fun  ;tion 


=  Background 

B  =  Human 

C  =  Animal 

D  =  Unspecified 


Figure  5.  Hierarchy  of  classes  in  ultrasonic  and  profiling  data 


Consider  now  a  set  of  input  points  rangin  i  from  -2  to  12 
along  both  feature  axes.  Figure  4  shows  the  ass  assigned  to 
each  class  in  the  hierarchy  for  all  points  in  this  range.  All 
points  at  the  same  2-D  location  across  all  five  images 
comprise  a  computed  mass  function  for  a  sin  *le  input  point. 
As  is  to  be  expected,  the  mass  peaks  for  singl  iton  classes  are 
at  the  mean  value  of  feature  space  of  the  trai  ing  samples  of 
that  particular  class.  For  the  unions  of  classes  representing 
uncertainty,  the  mass  peaks  at  points  rougily  equidistant 
between  the  child  classes. 

IV.  Example  Fusion  Of  Real  Sensor  Data 

In  order  to  illustrate  the  above  approach  and  the 
computation  of  a  fused  solution,  an  example  is  presented. 
Utilizing  data  generated  by  two  real-world  sensors:  an 
ultrasonic  micro-Doppler  sensor  and  a  PIR  p  ro filing  sensor. 
Both  are  capable  of  a  basic  binary  detection  when  signal 
energy  rises  above  a  certain  threshold;  be  rond  that  their 
classification  capabilities  differ.  The  profiling  sensor  can 
classify  between  a  human  and  a  horse,  whil  :  the  ultrasonic 
can  classify  a  human  but  cannot  explicitly  cla  isify  an  animal. 
This  difference  in  granularity  is  illustrated  in  igure  5. 


A.  Ultrasonic  Microdoppler  Sen  sor 

The  ultrasonic  micro-Doppler  sensor  used  here  consists 
of  a  send  and  receive  channel.  The  send  channel  emits  a  40 
kHz  carrier  wave,  allowing  motion  in  the  scene  to  be 
characterized  by  the  modulation  in  frequency  sensed  at  the 
return  channel.  In  particular,  the  periodicity  of  a  human  gait 
can  be  extracted  fairly  robustly  if  an  actor  is  walking 
towards  or  away  from  the  sensor. 

In  order  to  extract  meaningful  features  from  the  return 
signal,  it  is  first  demodulated.  T  Len  a  low  pass  filter  is  used 
to  remove  the  carrier  signal  an  noise  outside  the  relevant 
band.  This  signal  is  then  Han  ling  windowed  into  4096 
sample  segments,  equivalent  to  roughly  25  msec  at  a  160 
kHz  sampling  rate.  The  FFT  of  each  window  is  computed 
and  the  energy  below  the  LPF  cutoff  is  summed.  This  step 
effectively  yields  a  down  sampled  version  of  the  original 
signal.  The  first  characterized  eature  is  simply  the  mean 
value  of  this  summed  energy  signal  across  a  100  sample 
window,  corresponding  to  approximately  1.2  seconds.  This 
feature  provides  the  basic  ability  to  detect  motion  of  any  sort 
in  the  scene.  The  second  featur  :  is  obtained  by  computing 
the  autocorrelation  of  this  windowed  signal.  The  main  peak 
of  the  autocorrelation  approxi  nates  the  main  period  of 
motion  of  the  scene,  and  is  effective  at  classifying  a  human 
walking  versus  random  motim.  Figure  6a-c  on  the 
following  page  shows  the  sUps  of  this  process:  the 
spectrogram  of  the  down  samp  ed  and  filtered  signal,  the 
summed  energy  signal,  which  roughly  traces  the  periodicity 
in  the  spectrogram,  and  finally  the  autocorrelation  and  the 
computed  peak. 

B.  PIR  Profiling  Sensor 

The  profiling  sensor  used  ii  this  paper  consists  of  a 
linear  array  of  1 1  nodes.  The  sensor  in  effect  produces  a  two 
dimensional  image  with  the  axes  being  time  and  height.  This 
image  is  then  post  processed  to  sroduce  profiles  of  objects, 


Figure  4:  Mass  assignments  from  simulated  data 
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which  can  be  useful  in  discerning  objects  of  different 
dimensions  and  orientations. 

Given  a  sample  of  the  profiling  data  windowed  in  time, 
it  is  first  necessary  to  subtract  the  values  in  each  row  from 
the  mean  of  that  row.  This  procedure  produces  a  normalized 
image,  and  the  standard  deviation  of  the  pixel  intensity 
values  serves  as  the  first  feature  to  discern  an  object  in  the 
scene. 


Figure  6a.  Spectrogram  of  the  down  sampled  and  filtered  signal 


Figure  6b.  Summed  energy  signal 


Figure  6c.  Autocorrelation  and  the  computed  peak 

Next  the  image  is  converted  to  a  binary  image  by 
applying  a  threshold  to  the  pixel  intensities.  The  coordinates 
of  all  pixels  that  exceed  the  threshold  are  arranged  in  a  two 
column  matrix  and  the  covariance  matrix  is  computed.  The 
eigen  decomposition  of  this  covariance  matrix  is  performed. 
As  described  in  [9],  the  objects  orientation  and  eccentricity 
are  estimated  from  these  values.  The  orientation  is  estimated 
as  the  angle  from  the  image  x-axis  to  the  eigenvector 


associated  with  the  largest  eigenvalue.  The  eccentricity  is 
estimated  by  the  ratio  of  the  two  eigenvalues. 

Figure  7a-c  illustrates  the  steps  of  the  feature  extraction 
for  a  human  sample.  This  figure  includes  the  original  image, 
the  normalized  image,  and  the  threshold  image.  The 
computed  major  and  minor  axes  of  the  image  are  overlaid  on 
the  threshold  image  for  clarity.  Note  the  image  axes  are  not 
of  equal  scale,  so  although  orthogonal  axes  are  computed, 
they  do  not  appear  as  such. 


Figure  7a.  Original  image  from  profiling  sensor 
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Figure  7b.  Normalized  image  of  profiling  data 


Figure  7c.  Threshold  image  from  profiling  data  for  feature  extraction 
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C.  Realization 

The  realization  of  the  D-S  based  approach  is  greatly 
simplified  by  the  use  of  a  class  membership  matrix,  C,  for 
all  computations.  Similar  to  a  graph  adjacency  matrix,  the 
class  membership  matrix  takes  on  binary  values  to  indicate 
to  which  parent  classes  each  child  class  belongs,  and 
conversely  which  classes  are  child  classes  of  each  parent. 
The  matrix  is  populated  as  in  equation  (6). 


C(iJ) 


Jl  £  COj 

[0,®,  <2  COj 


(6) 


The  parent  classes  to  which  a  child  belongs  can  now  be 
determined  by  simply  searching  for  1  in  the  corresponding 
column.  Similarly,  the  children  of  a  class  are  found  by 
searching  the  corresponding  row.  For  example,  each 
iteration  of  the  algorithm  depicted  in  Figure  3,  the  matrix  is 
searched  first  for  any  columns  with  a  sum  of  1,  indicating  a 
top  level  node.  The  corresponding  row  is  then  searched  to 
determine  its  children.  The  matrix  is  pared  down  and  passed 
through  each  iteration  until  there  are  no  child  nodes  left. 
This  process  is  also  used  to  ease  the  computation  of  belief 
and  plausibility,  as  well  as  fused  masses.  For  example, 
belief  can  be  computed  by  simply  multiplying  the  matrix  by 
a  vector  of  computed  masses  since  each  row  selects  a 
proposition  that  directly  supports  the  corresponding  class. 
Plausibility  can  be  computed  by  performing  a  logical  OR  of 
the  same  row  and  column,  selecting  all  indices  in  the  mass 
function  that  do  not  contradict  the  corresponding  class. 


sensors.  Table  1  follows  the  class  hierarchy  established  in 
figure  5. 

In  this  example,  the  profiling  sensor  has  substantial 
uncertainty  in  the  class  of  the  object.  While  a  simple 
classification  rule  based  on  largest  individual  mass 
assignment  would  still  assign  the  class  label  B  for  human, 
there  is  also  significant  mass  assigned  to  both  uncertainty 
and  background.  Clearly  the  profile  of  the  human  is  narrow 
in  time,  which  leads  to  small  peaks.  The  small  peaks  cause 
some  confusion  with  the  background  when  considering  the 
standard  deviation  of  the  pixels.  The  ultrasonic  sensor 
similarly  assigns  the  majority  of  mass  to  class  B  human,  but 
in  this  case  assigns  substantial  mass  to  class  D.  While  it  is 
near  certain  that  motion  has  been  detected  in  the  scene,  it  is 
unclear  whether  the  motion  can  be  specifically  ascribed  to  a 
human.  Fusing  these  two  results  produces  a  much  more 
convincing  mass  function.  In  this  case,  nearly  all  mass  is 
assigned  to  support  class  B  human. 


D.  Sample  Fusion 

Using  the  aforementioned  approaches,  raw  data  from 
each  of  the  two  sensors  is  converted  in  to  a  feature  space 
representation.  The  ultrasonic  data  set  contains  88  samples  of 
human  motion,  43  samples  of  non-human  motion,  and  81 
samples  of  background  with  no  motion.  The  profiling  data 
set  contains  92  samples  of  human  motion,  43  samples  of 
horse  motion,  and  102  samples  of  no  motion.  Figure  8a-b 
shows  the  distribution  of  training  samples  for  both  sensors  in 
their  respective  feature  space. 

It  should  be  noted  that  although  the  data  here  is  of  similar 
objects,  it  was  not  collected  concurrently  and  therefore  does 
not  provide  a  detailed  assessment  of  improvement  in 
classification  accuracy.  The  goal  here  is  only  to  illustrate  the 
ability  of  the  proposed  approach  to  combine  information 
from  two  disparate  sensors,  which  provide  different  levels  of 
classification. 

To  provide  an  example  of  the  fusion  of  these  two  sensors, 
one  human  sample  is  left  out  of  each  sensor’s  data  set.  The 
prior  distributions  for  all  classes,  including  uncertainty,  are 
computed  using  the  remaining  samples.  The  left  out  samples 
are  treated  as  a  coincident  test  sample,  and  from  these  each 
sensor  model  produces  a  D-S  mass  function.  These  mass 
functions  are  fused  using  Dempster’s  rule  of  combination. 
Given  in  Table  1  is  the  resulting  individual  mass  function 
computation  of  each  sensor  and  the  fused  result  of  the  two 


Figure  8a.  Feature  space  plots  of  profiling  training  data 


Figure  8b.  Feature  space  plot  of  ultrasonic  micro-Doppler  training  data 


Table  1 .  Results  of  mass  computation  and  fusion 


Sensor 

Class 

A 

B 

C 

D 

Profiling 

0.1899 

0.5667 

0.0415 

0.0007 

0.2012 

Ultrasonic 

0.0150 

0.5290 

— 

0.4560 

0.0001 

Fused 

0.0075 

0.8505 

0.0242 

0.1177 

0.0001 

2213 


V.  Summary 


Herein  we  provide  an  application  of  the  Dempster- Shafer 
theory  method  for  personnel  detection.  The  Dempster- 
Shafer  theory  provides  the  capability  of  fusing  orthogonal 
data  from  an  ultrasonic  micro-Doppler  and  PIR  sensors. 
Utilizing  two  sets  of  real-world  data  from  aforementioned 
sensors  that  were  collected  separately  we  complete  an 
investigation  of  the  benefits  of  sensor  data  fusion.  The 
application  of  the  outlined  approach  provides  a  hierarchal 
approach  to  classification  /  discrimination  through  fusion  of 
the  disparate  information  resulting  in  a  series  of  solutions 
with  a  greater  confidence  in  comparison  to  a  standalone 
sensor  solution.  In  our  analysis  several  areas  of  improvement 
result  specifically  the  capability  to  have  multiple  classes  and 
multiple  confidence  states  for  given  problem.  The  utilization 
of  multiple  classes  afforded  by  the  Dempster-Shafer  theory 
increases  the  robustness  and  quality  of  the  information  from 
the  given  suite  of  sensors. 
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